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Abstract 

Recently a number of approaches has been developed to connect the microscopic dynamics of particle systems to the 
macroscopic properties of systems in nonequilibrium stationary states, via the theory of dynamical systems. This way a 
direct connection between dynamics and Irreversible Thermodynamics has been claimed to have been found. However, 
the main quantity used in these studies is a (coarse-grained) Gibbs entropy, which to us does not seem suitable, in its 
present form, to characterize nonequilibrium states. Various simplified models have also been devised to give explicit 
examples of how the coarse-grained approach may succeed in giving a full description of the Irreversible Thermodynamics. 
We analyze some of these models pointing out a number of difficulties which, in our opinion, need to be overcome in 
order to establish a physically relevant connection between these models and Irreversible Thermodynamics. 



1 Introduction 

In recent years, important connections have been made between the theory of chaotic dynamical systems and 
the statistical mechanics of systems in nonequilibrium stationary states. This is based on the widely accepted 
belief that the dynamics of the microscopic constituents of matter is chaotic, as also formally expressed by the 
following Q]: 

Chaotic Hypothesis (Gallavotti-Cohen, 1995): A reversible N -particle system in a stationary state can 
be regarded as a transitive Anosov system, for the calculation of its macroscopic properties. 

Although the dynamical systems methods have led to many interesting insights of physical interest, their 
application to elucidate the behavior of macroscopic systems, as done in statistical mechanics or (Irreversible) 
Thermodynamics has lead to difficulties which, in our opinion, have not yet been fully resolved. There seems 
to be, then, a qualitative difference between pure dynamics and thermodynamics (see, e.g. for some facet of 
this difference not considered here). 

In this paper, we will try to clarify some aspects of the recently developed attempts to incorporate Irreversible 
Thermodynamics (IT) into the framework of dynamical systems theory. In this connection we will concentrate on 
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the interesting recent works by Gaspard (G) || |j; by Breymann, Tel and Vollmer (BTV) §, § ; and especially by 
Gilbert and Dorfman (GD) [Q, who extensively investigated the connection between a coarse-grained "entropy" 
and IT in nonequilibrium states. Early works relevant to our discussion had already appeared in 1996, cf. H. 

The concept of coarse-grained entropy in the study of nonequilibrium systems has been discussed in the 
past. As a matter of fact, Gibbs himself introduced a coarse grained entropy to circumvent the difficulty that, 
the Gibbs entropy Sg (cf. eq.(|^) below), does not change during the time evolution of a Hamiltonian system 
j^]. Similarly, the final goal of introducing the coarse graining in could be stated as that of circumventing 

certain difficulties which affect the Gibbs entropy of nonequilibrium systems, thus building a complete description 
of all quantities occurring in IT (cf . Eq. ([!]) below) in purely dynamical terms. The guiding idea in this endeavor 
is the identification of the irreversible entropy production rate with a special form of loss of information rate, 
to be defined below (cf. subsection 3.1). We begin our analysis with a description of the results obtained so far 
with the coarse grained approach, and then consider the difficulties which we find with it. This way, we indicate 
what might have to be considered further, in order to obtain a consistent theory of IT. 

We note that a coarse-grained description -both in space and time- is also at the basis of IT itself fLOf . 
Indeed, the basic equation for the entropy change in IT is [10(a)] 

^ = 1^5 + ^5], (1) 

T T 

where we have divided by a small but finite time r to obtain the rate of entropy change. Here, A e S is the 
entropy exhanged by the system with its surroundings, while AiS is, respectively, the entropy produced inside 
the system, in a time r. This relation can be re- written in the more usual local differential form as JlCj] : 

dps 

—— = -div J s jot + & : a > (2) 

where p is the density of the system, s is the entropy per unit mass, 3 s ,tot is the total entropy flow rate per unit 
area corresponding to the term A e S/r, and a is the entropy production rate per unit volume. In particular, for 
a diffusive system, the term a can be related to the gradients in space of the densities of the various diffusing 
substances. Therefore, space derivatives of various quantities appear in the expressions for the entropy flow and 
entropy production rates. Equation (||) can also be written as 

ds 

p— = -div J s + a , J s = J 5 ,tot - J s ,c (3) 
where J s . c = psv is the convective flow, and v is the fluid velocity. 



2 Gibbs entropy and (nonequilibrium) dynamical systems 

We begin with a dynamical system (X 7 0') representing the dynamics of an ./V-particle system in 3 dimensions. 
Then, X C M 6N is the phase space of the system, and is an invertible transformation of X into itself for all 
times t £ M. Given a probability measure on X at time 0, the dynamics of the system induces an evolution 
which in terms of the measurable sets A C X can be expressed by 

Ht(A) = tM,^-*A) , teM. (4) 

This expression defines the time evolution of the probability distribution in phase space, such that the "mass" 
in the set A at time t, p t (A), is the same as it was in <j)~ t A at time zero, po(4>~ t A). The measure /it can be 
seen as characterizing the state of the particle system at time t, in the sense that the expectation values of 
the "observables" O of the system (e.g. smooth functions of phase, O : X — * R) are given as averages of such 
functions with respect to pt- 
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Gibbs Entropy: If pt has a density pt on X, i.e. p t (dx) = pt{x)dx, the Gibbs entropy of the system at time 
t is defined by the quantity 

S G (t) = -k B Pt (x) [log p t (x) - l]dx (5) 
Jx 

where k B is Boltzmann's constant^ 

We refer to Sq as to a fine grained quantity to emphasize its difference from the coarse grained quantities 
defined below (e.g. Eq.(|l4|)), in the sense that its definition involves an integral over X instead of a sum over a 
partition by finite- volume sets of X. 

Unfortunately, the stationary states of the current models of noncquilibrium physical systems, seen as dy- 
namical systems, are represented by singular measures p for which eq.(^|) does not make sense 0, [3| Q]- It is then 
argued (cf. Section 8.6) that coarse grained entropies should be used to characterize these noncquilibrium 
stationary states "... especially if we want to keep the operational interpretation of entropy as a measure of 
disorder. " In the following subsections, we describe two classes of models, showing how singular measures arise. 



2.1 Thermostatted systems 

Consider an TV-particle system whose equations of motion contain the action of an external force field F e and 
compensating ( "thermostatting" ) terms, which eliminate the increase of the (dissipative) energy of the system 
due to the work performed on the particles by F e , so that the system will finally reach a nonequilibrium 
stationary state fTlj| . The equations of motion of one such system are: 

* : : SV^e f , * = 1, x = (q, P ) e X c M m , (6) 

p 4 = F\ + Ff-a(x)p t 

with periodic boundary conditions, so that X can be assumed to be compact. Here m is the mass of the 
particles; F • and F^ are the forces on particle i due to the other particles in the system and to the external field, 
respectively; x = (q,p) = (q.;, Pi), i = 1, N, stands for the collection of all the positions and momenta of the 
particles; and a(x)pi represents the effect of the "thermostat" on the system. The thermostatting function a(x) 



is obtained from Gauss' principle of minimum constraint |11 and is usually chosen in such a way that either 
the kinetic or the total energy of the system remain constant in time. We refer to such systems as thermostatted 
systems. For constant total energy [isoenergetic (IE) constraint], one obtains: 

a(x) = a IE (p)= „ m £ * , (7) 

which shows that a(x) is of order O(l) and is related to the dissipation or the (generalized) entropy production 
rate in the system^ Indeed, if we define the current (flux in IT) at time t as Jt = (X^P*/ m )t ( an average 
with respect to the time dependent distribution p t ) and similarly set the average (X}j=i ^~)t equal to 3Nk B T t , 
where T t is the kinetic temperature of the system at time t, then, for a constant external field F e (force in IT) 
and for a large system (large N) we can write: 

/ \ ■ F e . . 

3Nk B T t 

which yields the IT entropy production rate per degree of freedom at time t. 

Starting from a distribution po on X with density po, the time evolution of the dissipative system Eqs.(^),(Q) 
gradually rearranges the distribution, concentrating it on sets of smaller and smaller volume in phase space. 

1 The constant "—1" in the integrand of Eq. (JsJ) is introduced only for consistency with the definitions of |j| ^, Q . 

2 We speak of generalized entropy and of kinetic temperature below because our systems are not necessarily close to equilibrium. 
Our definition of kinetic temperature can be modified to involve the peculiar velocities, if the center of mass of the system is not 
at rest H. 
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This produces what is usually called a phase space contraction, together with a sequence of more and more 
irregular densities {pt}t>a- In the long time limit, a singular distribution is obtained, which assigns a probability 
of one to sets of zero phase space volume. These sets are, in general, dense in X if the external field is not too 
large, but with decreasing fractal dimension for increasing fields, till they are not dense anymore at high fields 
(cf. [p3 for the Lorentz gas). 

The rate of variation of S G for alH > is (@, p.252): 

S G (t) = ^(t) = ~3Nk B {a) t + 0(k B {a) t ) , (9) 
at 

since the divergence of the equations of motion, Eqs.(^J), is given by 

div x = -3Na(x) + 0(a{x)) . (10) 

We note that Sc(t) converges to a negative constant value, Scit) ~ —3NkB(a) S s for large N and large t, where 
the subscript ss in (a) ss indicates the steady state value. The result is that Sc(t) diverges to — oo as t — » oo 
Jll| , and it does so in an approximately linear fashion after a given relaxation time. Equation @ is similar in 
content to Eq.(16) of Goldstein, Lebowitz and Sinai Jl3| for positive times. 

This dynamical description of a system in a nonequilibrium state yields the IT expression for the irreversible 
entropy production rate at any instant of time t > 0, which is obtained from Eq.(||). Surprisingly, Soft) is 
observed to equal precisely the negative of this irreversible entropy production at all times t, cf. Eqs.(^,^). 
Thus, although so far it has not been possible to identify a quantity representig the entropy of the system, a 
connection between IT and an appropriately constructed function, somehow related to Sq, has been discovered. 
This, however, is not sufficient to imply that the entropy of the system should be linked with Sg- On the 
contrary, as discussed below in Section 4, the asymptotic divergence of Sq suggests in fact that attempts to 
find such a link are likely to fail. 



2.2 Multibaker maps with flux boundaries 

A different class of nonequilibrium models is represented by finite multibaker chains coupled at both ends to 
infinite "reservoirs" i.e. chains with flux boundary conditions. These models give rise, in the "macroscopic 

limit" ,[] to stationary states characterized by singular measures in phase space, and are thought to behave 
similarly, on some respects, to certain ideal gas systems, such as the Lorentz gas considered by G in Chapter 8 
of§- ' 

Several variations of these multibaker systems have been considered. We follow G's definitions || ^| first. 
The space of the multibaker map with flux boundaries X is made of a chain of squares B n = [0, 1] x [0, 1], 
n G {... — 2,-1,0,1,2,...} each placed at one site of an infinite one-dimensional lattice, as depicted in Fig. 
1. The central section of the chain, whose squares are labelled by n = 0, 1, ...,L, represents a system coupled 
to two reservoirs: one at its left boundary (the squares labelled by —1,-2,...), and the other at its right 
boundary (the squares labelled by L + 1, L + 2, ...). Each B n contains a certain number of points, thought to 
represent noninteracting particles, distributed according to a given distribution fj,(n,x,y) defined on X, whose 
time evolution is defined in different ways for the system and the reservoirs respectively. In practice, one time 
step moves the point (n,x,y) (the point (x,y) of B n ) to the point (j)(n,x,y), where 



i,x,y) 



' (n- 1,2a;, |), < x < 1/2, 1 < n < L + 1 

(n+l,2x,*±i), l/2<a;<l, -l<n<L-l 

(n-l,x,y), 0<x<l/2, n<0,n> L + 2 

(n+l,x,y), 1/2<x<1, n<-2,n>L 



(11) 



as depicted in Fig. 1. This dynamics is area preserving. Starting with appropriate initial point distributions in 
the infinite chain, one obtains a system of points coupled to two reservoirs, which feed points into the system at 

3 We put in quotes "reservoirs" and "macroscopic limit", as they are crucial for a connection with IT as explained below. 
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the fixed densities, p+ (the left reservoir) and p- (the right reservoir). By density we simply mean the number 
of points per unit area, in each region of X. During the time evolution a certain density profile is created, 
possibly converging to an invariant distribution in the long time limit. 

Because infinitely many points are required for the reservoirs, the measure p is not normalized. However, 
a probability distribution \ ( c f- Eq.fllC) below) can still be given for this system, considering the Poisson 
suspension measure associated with /x ji, In this case, the phase space M of the system of "independent" 
points is part of the power set V(X) of the multibaker space X. In A4, a "Gibbs entropy" can be defined as 
usual, if x is not singular. 

In the stationary state considered in H Q the density profile is made of two kinds of strips only: those 
having density p+ and those having density p_, which are separated by straight line segments. In the squares 
which are closer to the left reservoir, the strips with density p + dominate, while those with density p_ dominate 
at the other end of the system, so that p(B n ) is linear in the squares' label n, for < n < L. As long as L is 
finite, the corresponding Poisson measure x is not singular. However, in order to obtain results which serve the 
purpose of nonequilibirum statistical mechanics, singular measures are needed in G's approach (cf. B p. 384). 
These are obtained in j| |J] through a "macroscopic limit", defined by L — > oo and (p+ — p-)/L ^constant. 
In this limit, the invariant distribution p becomes singular: the strips with the two different densities become 
thinner and thinner and more and more numerous, while p+ grows without bounds. The corresponding Poisson 
measure x is a l so singular, hence So cannot be defined. 

An interesting generalization of G's model was proposed by BTV 0, The baker space X now consists of 
a chain of identical rectangles of sides a, in the horizontal direction and b in the vertical direction, respectively, 
Fig. 2. The boundary conditions can still be implemented by two infinite reservoirs as above. The dynamics 
are also slightly more general (Fig. 2). Each rectangle is divided in three vertical strips of horizontal widths 
la, sa and ra (from left to right), respectively, where l,s,r > 0, and I + s + r = 1. Each rectangle is also 
subdivided into three horizontal strips of width a and heights rb (bottom strip), sb (central strip) and lb (top 
strip). The leftmost strip of rectangle to is compressed and expanded and moved to fit the bottom horizontal 
strip of rectangle m — 1 (nearest left neighbour); the central vertical strip of rectangle to remains in rectangle 
to, but is stretched and compressed so that it fits in the central horizontal strip; the rightmost vertical strip 
of rectangle m is stretched and compressed to fit the top horizontal strip of rectangle to + 1 (right nearest 
neighbour). The same procedure is applied to each rectangle of the system, while the points of the reservoirs 
are merely translated to the left and the right, without volume compression or expansion, like in ||.f] 

Accordingly, after one time step, the distribution has changed in the chain, and with that the density of 
points in each rectangle as well as in each strip has changed. Let g m be the density in rectangle to. This density 
evolves in the system like 

Q m (t + t) = (1 - r - l)g m (t) + rg m -i(t) - lg m+ i(t) . (12) 

Again, the invariant distribution p in the baker space X and the associated Poisson measure Xi are singular 
and Sg is not defined. However, the mechanism through which the singularities are created is not by taking a 
macroscopic limit like in p, m, but by a combination of phase space contraction and boundary effects. 



3 The coarse-grained approach 

To avoid the fact that Sg is not defined in the current models of nonequilibrium stationary states, as discussed 
in Subsections 2.1 and 2.2, several attempts have been made to replace Sg by a coarse grained information 
entropy^] which takes finite values in the case of both non-singular and singular distributions 7\. This 

approach is invoked in order a) to give a precise meaning to the concept of nonequilibrium entropy [6]; b) to 
properly handle the singularities of the stationary states, without giving up the interpretation of entropy as a 

4 G's original model J^] then corresponds to taking I = r = 1/2, and s = 0. 

5 To clear lv distinguish between the physical entropy of IT and dimensionless information related entropies, we follow Nicolis 
and Daems |15| , and choose to call information entropy a dimensionless entropy-like quantity. 
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measure of disorder H p. 370; c) to have a microscopic definition of the entropy production rate which agrees 
with that [Eqs.([l])-(||)] of IT [Q. This would amend the restriction encountered in the usual thermostatted 
systems approach, where only the irreversible entropy production appears and not the complete description of 
IT, as given in Eq.(|IJ). Here, we will follow GD's approach and notation, which generalizes to some extent the 
previous ones, and emends some aspects of the original definitions of ^ [3J. 

GD first consider a generating partition, A, for the phase space X. Then a discretization of the time 
evolution by time steps of length t, is introduced to produce finer and finer partitions Ait^'- 

A ttk = <b- lT {A) V (b- (l - 1}T {A) V ... V A V ...4> {k ' 1)r {A) (13) 

by taking the intersections of the cells of A evolved by the dynamics of cj) T up to k — 1 time steps forward in 
time and up to t time steps backwards in timej^j The symbol V indicates the intersection of all the sets of a 
given partition with those of another one. In particular, we have At+\,k = 4 > ~ 1 Ae.k V A^u- Also, GD indicate 
by /it the phase space distribution and by v the Liouville measure. 

GD information entropy: Consider all the sets of the form B ~ UiEi, with Ei S At,k, i-e- all the sets which 
are unions of the cells of Ae,k- On these sets the GD coarse-grained information entropy Sf®(B,t) is defined 
by 



sgP(B,<) = - J2 km 

AeA t+1 , k nB 



(14) 



where the sum is carried out over all A £ Ai+i.k whose union is B . 

The relation between Sfj? and Sq, in the case that /it has a density pt, is then given by: 

S G (t) = k B Sj(t) = k B lim S?°(X,t) , (15) 

— >oo ' 

where we also defined the fine grained information entropy Si. Hence, for regular measures, the coarse grained 
entropies approximate better and better their fine-grained counterparts, when the graining of phase space is 
made finer and finer. On the contrary, if /i t is singular, Sg and Si do not exist, while Sf® for any £,k £ IN 
does. 

The total rate of information entropy change in a time r is then defined by: 



AtotS? " {B ' t] = l[Sff(B,t + T)-S%?{B,t)] 



yGDf 
i,k 

T 

(16) 



E 

AeA e+1 . k nB 



»t(<f>- T A) iH(<fi- T A) !M(A) MA) 
t g v(A) t g v{A) 



where one has used Eq.(Q), /j, t+T (A) — fi t ((f> T A), to get the second equality. This rate of change is then 
decomposed by GD into a sum of three terms: 

tot ^ k ■ [A e Sf° + A th Sf° + A t Sf° ] , (17) 



T 



where, A e SfJ?{B) is called the change in information entropy due to the flow between B and its environment, 
AthSf®(B), the change in information entropy due to a thermostat in contact with the system, and AiSf k D {B), 
that due to irreversible information entropy production in the system. This separation is based on an inter- 
pretation of thermostatted equations of motion for particle systems such as Eqs.@, where the thermostatting 

6 These partitions are intended to be rigid frames into which the phase space X is subdivided once and for all. They are therefore 
not affected by the time evolution of the system, although the dynamics has been used to construct the partitions. Thus, once 
the partition At h nas been made, it remains in place without any change, independently of the dynamical evolution of the system 
which takes place "through it". 
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term is seen as representing a real thermostat. We remark that SfJ? is defined in terms of the phase space 
distribution /i t , hence changes of this distribution in phase space imply changes in SfJ?. 

In particular, the information entropy change rate due to flow is defined by GD as originally done by G 

by: 



T 



AeXt+i.fcnfl 



lo s ? j.-t r; lo s 



(18) 



while the change due to the thermostat is defined by 



AthS £k {B,t) 1 Q D( , G£) /,-TD .\1 

= - l s t,k i B ,t + T) - S i+lik _ 1 {<f) B,t)\ 

. -I E M0 -M,lo g i4O^. (!9) 

AeA e+ i, k nB v 7 

In the first equality of Eq. ([l9|) , the partition Ae,k is compared with its preimage under <fi~ T , i.e. with Ai+i.k-i = 
<f>~ T Ae k, which should correspond to a different degree of resolution of the phase space. The term AjS?®(B, t)/r 
in Eq.(17) is then deduced from Eq.(^) itself, once the other terms have been defined by the Eqs. fll6|) , (E8[) , (|l9|) . 



3.1 Gilbert— Dorfman results 

We first discuss the connection of GD's theory with IT. For that, the term Ath,SfP{B, t)/r is crucial. Consider 
thereto the case in which B = X, and the system is in a stationary state characterized by the natural (invariant) 
measure /i. If we denote by J the Jacobian determinant of the transformation <j) T , we can write 

u(^(A)) = J dx= V [f (20) 

where, under the assumption that the dynamics <j) T are smooth, x A is determined by the mean value theorem. 
Now, letting the graining of phase space become infinitely fine (i.e. letting £, k — > oo), we obtain: 

A th Sr_ Um \ h Sf°(X) = I lnJ{x)Kdx) = y x . (21) 



t,k- 



X 3 = 1 



where the Xj 's are the Lyapunov exponents determined by the dynamics <j) T . The sum of the Lyapunov exponents 
is negative and [i is singular with respect to the Lebesgue measure if the system is strictly dissipative |fl6f . Hence, 
A t hSf^ ) (X)/T, for sufficiently large I and k, will also be negative in such a case. 

Combining this with the assertion that A e SfJ?{X) and A to tSf®{X) both vanish in the stationary state, 
allows GD to set: 

Mi . lim ^mm . _ lim _ _ ,2 2 ) 

so that the irreversible entropy production AiSfJ? has the proper positive sign for dissipative systems. The 
irreversible production is here obtained as the "loss of information" about the probability distribution in going 
from one level of resolution (that of Ae+i.k) to another (that of Ai+2,k-i) level of resolution in the graining of 
phase space.]] We remark that in the definition of A e Sf®, Eq.(|i~8|), and hence of AiSf®, the term Sf k {4>~ T B, t) 

7 We put in quotes "loss of information" to stress the fact that this does not directly correspond to the usual (Kolmogorov-Sinai) 
loss of information of dynamical systems theory. In fact, the second level of resolution is not necessarily coarser than the first, it is 
merely different. If A is a Markov partition, then Ae±2,k— 1 i s coarser than At+i,k in the stable directions |17|. 
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appears. However, there may be no collection of cells A of At,k whose union is the set <fi~ T B. For this reason 
the finer partition Ai+\ t k had to be introduced in the definition of the GD information entropy Eq.([l4|) (cf. 
Figure 3). 

3.2 Gaspard's results 

In G's book a review of his previous work is given, in which a special kind of partitions was considered: 
partitions whose cells all have the same phase space volume e. This was only for simplicity and does not change 
the substance of the results. Therefore, we will denote G's partition with the symbol A. 

Gaspard only considers systems of independent points coupled to infinite reservoirs (thought to represent 
driven systems of noninteracting particles) and proceeds with the construction of a Poisson suspension measure 
X, from which a coarse grained entropy can be defined. One can see that this coarse grained entropy reduces to 
the GD information entropy plus a rest term (cf. Eq.(|42|) below). Gaspard then argues that this rest term can 
be made small with respect to the GD information entropy by taking the size of the partition cells sufficiently 
small. Therefore, the rest term may be neglected, and G's calculations are then equivalent to GD's calculations. 
In particular, the term called e-entropy flow by G, Eq.(8.105) of 0, is nothing other than GD's A e SqP , if one 
starts from a partition A made of equal cells of size e and takes Ae t k with i = 0, k = 1. The same holds for 
the e-entropy production, Eq.(8.106) of which equals GD's A^S^f. On the other hand, Gaspard only uses 
dynamics which are phase space volume preserving B, and he does not consider the term AthSfJ?. 

Applying G's theory to the case of multibaker dynamics one obtains the following relation, Eq.(8.125) of Q: 

AiSgf = D^—^- + higher order terms (23) 

where D is the diffusion coefficient in the multibaker space X, p is the density of the points moving through 
X via baker-dynamics, while Vp is the corresponding stationary state gradient of p imposed by the presence 
of the unequal density in the boundary reservoirs. Note that the independence of the points, which allows the 
construction of a Poisson suspension, is crucial here to pass from a description in the phase space M to the 
"1-point" (thought to be 1-particle) space X, making the operator V a gradient in real space. 

The quantity AiS^® then turns out to have the desired form expected from IT for diffusion, which can be 
related to the (baker map) diffusion coefficient D by, Eq.(8,126) of 

lim lim lim -A^-A^f = D > , (24) 

e^O (Vp/p)^0L^oo (Vp) 2 U ' 

where L is the size of the system between the two reservoirs. Equations ( p3| , p4| ) represent the first instance in 
which IT-like expressions for diffusive systems were derived from an area-preserving map. 

3.3 The Breymann-Tel-Vollmer results 

In the more general multibaker model considered by BTV, two kinds of coarse grained information entropies 
were defined: one, S^ TV,C , using the densities of points in each rectangle of area ab, and another one, S^ rv ' C , 
using the single horizontal strips (of area alb, asb and arb respectively) of each rectangle, Fig. 2. The collection of 
baker rectangles constitutes one of the two partitions of the system considerd by BTV {Ai.k in GD's notation), 
while the collection of the three horizontal strips of all rectangles constitutes the other partition (Ai+i.k)- The 
two coarse grained quantities are 

S^ = -abg m log^ (25) 
Q 

oBTVC t i Qm.b j i Qm.c 7 , , Qm.t fr,c\ 

b m = -arbg mtb log — asbg„ hc log — albg m , t log — — , (26) 
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where g* is a constant reference density, g m ,b is the coarse-grained density on the bottom horizontal strip of cell 
fn, Qm,c is the coarse-grained density on the central strip and g m j is the coarse-grained density on the top strip 
of cell m. The variation in time of the coarse grained entropy S^ TV,C is split into two terms: the flow term 

A e S^(t) = S B J V - C {t + r) - S* TV - C (t) , (27) 

which is assumed to be the same as the total variation S^ V ' ; and the irreversible information entropy 
production term 

A lS ^ c (t) = (S* TV ' c (t + r) - S* TV > c (t + r)) - (S* TV "(t) - S^ c {t)) . (28) 

The sum of A e S , ^ TV,c and A.iS^ rv,c is then the total variation of S^ FV,C in one time step. 

The next important ingredient of BTV's approach is the macroscopic limit for these multibaker models. 
This uses an expansion up to second order derivatives in terms of the horizontal coordinate x for the density: 

a 2 

g(x ± a) = g(x) ± ad x g{x) + —d 2 g(x) . (29) 

Furthermore, the system is seen as a biased random walk on the line, so that one can attribute to it a given 
drift velocity v and a given diffusion coefficient D for each choice of r and I. The quantities r,l,v,D can then 
be used to define a scaling for the parameters a and r: 

tD i av \ , tD / av \ . , 

so that a meaningful fine grained limit is obtained, in which both a and t tend to zero. Then, the following 
expression results for the irreversible information entropy production [^) : 

btv Q A. t^Q" 2 



°""'i>{°- D f) (31) 

which, in the case with r = I = 1/2, i.e. v = 0, reduces to the same formula as given by Gaspard, Eq.(|23|) above, 
except for the higher order terms present in Eq.(fj3[). 

Three observations are in order here. 1) The special choice of partitions made by BTV is not strictly 
necessary to obtain the BTV results. Different choices which are closer to GD's At t k are possible, as explained 
in the Appendix of 2) It is possible to keep higher order corrections in the calculations sketched above, so 
that terms corresponding to G's higher order terms of Eq.(p3|) can also be found within the BTV approach (cf. 
Ref.@). 3) The scaling given by Eqs.(|30|) is such that the relaxation time difficulty discussed below in Section 
4.2 does not appear in the BTV's approach. This scaling has been recently adopted also by Gaspard and Tasaki 
in [HI. 



4 Difficulties 

The results presented in the previous sections, give rise to a number of questions some of which we will discuss 
here, concentrating on their implications for a consistent dynamical theory of IT. In particular we will try to 
identify the range of validity of the results obtained, pointing out which problems should in our opinion still be 
clarified or overcome. 

4.1 The phase space difficulty 

Relations such as Eqs.(p3]),(|3"l|) for multibaker maps look similar to those obtained in IT where real-space 
gradients appear. However, this is somewhat misleading and due to the simplicity of the map, whose phase 
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space has in practice only one active dimension, (the direction of the density gradient in |I| or the direction of 
"transport" in || [t[] ) , and to the assumption that the multibaker dynamics are valid substitutes for independent 
particle systems. In that case, indeed, there can be two situations: a) the system is infinite and can be described 
by a Poisson distribution; b) the system is finite, and the many-particle distribution factorizes. In both situations 
we are allowed to go from a description in the phase space M. to a description in the 1-point space X, where 
there is only one active (real-space) dimension. Then, entropy-like quantities can only flow in this direction, 
giving necessarily rise to real-space expression such as Eqs.(|2^),(pT[) j^| This point will be examined further in 
Subsection 4.4. 

Some difficulty emerges when this approach has to be applied to a wider clss of models than that of multibaker 
maps. In particular, interacting particle systems are not compatible with this approach. To study these 
situations some improvement of the presently developed approach is required. Indeed, following the general 
definitions and derivations given in JtJ , one immediately realizes that in principle the flows and the gradients 
computed there are all in terms of phase-space variables, and not in terms of real-space variables: &. e SfJ?(B) 
represents a flow through the phase space volume B. Therefore, A e Sf® given by Eq.(13) could be seen as the 
substitute for the flow jf (Eq.(8.85) in (§) 

Jf = {-p\ogp)x, (32) 

which takes place in phase space, in the case that the state of the system is represented by a singular measure, 
for which the Gibbs entropy is not defined. In turn, Jg is reminiscent of the convective entropy flow of IT, 
cf. J SjC defined below Eq.(||), so that A e Sf®(B) could be thought of as representing J s , c f] However, the IT 
entropy flow takes place in real space, not in phase space, and the phase space cannot be reduced to real space 
if there are interacting particles, or if there is a flow in momentum space. Therefore, the diffusion coefficient 
D present e.g. in Eqs.(p4]),(^l|), in a more general context would concern diffusion in phase space rather than 
in real space. It is not clear, then, how the Gibbs entropy flow or its coarse grained substitute introduced in 
H-J7J, could be related to the IT entropy flow. 

4.2 The relaxation times difficulty 

In IT, the relaxation times of given processes, i.e. their approach from an initial state to a stationary state, are 
directly related to the transport coefficients. Obvioulsy, speaking of relaxation times, one should first indicate 
which physical quantities are observed to relax, and which tolerance is accepted in assessing the relaxation. In 
general, when dealing with particle systems, the relaxation time is intended to be determined by the relatively 
short Maxwell relaxation time, tm, which is typically the time of a few collisions per particle. In fact, the main 
physical observables approximate within measurable errors their stationary values in such a time. In any case, 
given the observables in which one is interested (e.g. smooth functions of phase) and the relaxation tolerance, 
the times needed for these observables to approach precisely enough the relevant limiting values are determined 
by the dynamics alone. On the contrary, the coarse grained quantities discussed in (J, [tJ have relaxation times 
which strongly depend on the size of the cells of the coarse graining partitions. 

This is similar to the problem of portraying the relaxation to equilibrium of an Hamiltonian system, by 
means of a coarse grained version of the Gibbs entropy However, in our case the situation appears worse. 
Indeed, in equilibrium the Gibbs entropy equals the physical entropy of the system, at least. On the contrary, 
in the case of systems evolving towards nonequilibrium stationary states, characterized by singular measures, 
Sq is not even defined in the stationary state. Hence, a coarse grained version of the Gibbs entropy in the study 
of relaxation towards nonequilibrium stationary states is at risk of being even less meaningful than in the case 
of relaxation towards an equilibrium state. We illustrate these facts with a simple example. 

8 Note that if the 1-dimensional chain of baker maps is replaced by a d-dimcnsional lattice of baker maps, the active dimensions 
are d, and flows only occur in the d-dimensional real-space. 

9 In the case that the space of the system and of the reservoirs are combined, as for multibaker models, this flow term would 
account for the total entropy flow. 
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Why doesn't the Gibbs entropy exist in the noncquilibrium stationary states of systems such as those 
described in Section 2? We have already seen that, starting from an initial state represented by a regular 
measure, hence with a given initial value of the Gibbs entropy, the time evolution is such that Sc{t) — > — oo as 
t — > oo. But, we could see more in detail why this happens, considering a simplified model of a thermostatted 
system of the kind discussed in section 2.1. The idea remains valid in general. Let the initial state be an 
equilibrium state, described by the microcanonical ensemble in a volume of size 1, and let the stationary 
distribution be confined to a small (not dense) fractal region of phase space. This situation corresponds to a 
case with high forcing and consequent high dissipation. Let us take a phase space partition At k, made of M 
cells of equal size e = 1/M. The corresponding initial coarse grained information entropy then verifies 

^(X,0) = 1. (33) 

In the following time evolution leading to a nonequilibrium stationary state, the overall phase space contraction 
due to dissipation makes the probability distribution gradually concentrate on smaller and smaller regions of 
phase space,0 until it differs from zero only on a number L — L(M) < M of cells of the partition. Assuming 
for simplicity that the probability to find the system in each of these L cells is the same, we then get 



S S s(M) = lim S?j?(X,t)=L 



Therefore, since the fraction L(M)/M tends to zero when M tends to infinity, we have S SS (M) — » — oo for 
(1/M) = e — > 0. In other words, the fact that the phase space probability distribution is rearranged by the time 
evolution, so that sets of zero volume take a probability of 1 in the stationary state, makes the Gibbs entropy 
diverge to — oo, indicating that there is no connection between the Gibbs entropy and the physical entropy of the 
system. This is still true even if the dissipation is small, and all sets of measure 1 are dense in phase space. 

Let us consider then, in more general terms, one thermostatted system evolving towards a nonequilibrium 
stationary state, whose initial state is represented by a regular measure /zo, for which the Gibbs entropy Sg(0) is 
defined. In the following evolution, Sc(t) gradually diverges to — oo, but at any positive time t the distribution 
/it remains regular, and the corresponding Gibbs entropy can be approximated better and better by finer and 
finer coarse grained entropies, as in Eq.(|15|). Because of the divergence of Sq and because the size of the 
partition cells needed in the definition of Sf® can be taken arbitrarily small, the total information entropy 
change, Eq.(^), can be kept different from zero during arbitrarily long times. Indeed, by taking finer and 
finer partitions, A tot S'^?(X, t)/r will approach better and better, and for longer and longer times, the rate of 
decrease of the fine grained information entropy Si = Sc/ks, given by Eq.(^), which has a definite negative 
value of order O(N) (« — 3N(a) ss ). Now, for every fixed t > (which could exceed tm by any amount), the 
state of the system is represented by a probability measure [it which has a density p t . Hence, given any tolerance 
S > 0, and any time increment r > 0, there will be an e$ tT > such that (cf. Fig. 4): 

\Sff(X,t)-S G (t)/k B \ <S and \S^(X,t + t) - S G (t + r)/k B \ < S , (35) 
if the size of the cells of the partition Aim is smaller than e<$ )T . It follows that 

A„ S g>(X,«) _ S G « + r) - S G( t) , Q m _ 1 d Sa + + f-\ = O(N) , (36) 



t k B T \t J ks dt 

instead of &.totSfj?{X,t)/T w 0, since we can take that 0(S/t) is 0(1) or less, because r is fixed a priori. 

Therefore, unphysical, partition dependent, relaxation times have been introduced through the coarse- 
graining procedure, which are extraneous to the dynamics of the system. 

The approach of BTV || seems to avoid the problem of the relaxation times, because of the way its authors 
defined their macroscopic limit, cf. subsection 3.3. In this approach one does not take finer and finer partitions 

10 Because we assume the attractor not to be dense in X, if the graining is sufficiently fine, there are cells of the partition which 
contain parts of the attractor and other cells which do not. 
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of each baker map rectangle; one only increases the number of rectangles between the reservoirs reducing their 
side a and the length of the time step r, in such a way that Eqs.(|3(]) are verified. Then, the fact that the number 
of time steps n has to increase in order for the entropy to reach its stationary value could be balanced by the 
decrease of r, so that nr may converge to a finite value. From this point of view, then, the BTV macroscopic 
limit should be preferred. 



4.3 The difficulty of unphysical definitions 

The relaxation times problem points out further difficulties: the very definition of the entropy flow and irre- 
versible entropy production could be flawed. Indeed, the total rate of variation of the real IT entropy, A tot S, 
relaxes to its stationary value zero in the relatively short time rjf, implying that this rate of variation becomes 
(and remains) smaller than a small <5 within a time of order 0(tm)- Therefore, for any arbitrarily chosen time 
t larger than tm, if the cells of the partition are smaller than es, T , Eq.(|36|) yields: 



T T 

where the second term on the l.h.s. is 0(8) or less, and the second is of order ksO(N). Assuming with GD 
that A e SfJ?(X : t) = 0, one can rewrite Eq.@, with Q and (Q), in the form 

^ [A th S^(X,t) + Ai5gP(X,t)] - \ [A e S(t) + AiS(t)} = k B 0(N) . (38) 

In particular, consider a value t which is not necessarily exceedingly large, but larger than tm- Without taking 
an extremely fine partition, and recalling that then ksO(N) is approximately equal to —AiS/r, as seen in 
subsection 2.1, we can write 

^A th S?°(X,t) « -A e S(t) - ^AiS?j?{X,t) . (39) 
t r t 

But this contradicts IT, according to which the quantity on the left hand side of Eq.(pS9|), being the overall 
coarse grained entropy flow, should approximately equal only the first term on the right hand side. Therefore, 
at least either AiSfP or A t hSf® cannot be correct. For, if AiSf® is of order O(N), as the irreversible entropy 
production should be, then A t hSf® is not the external entropy flow, while it should be, and if AiSfj? is not 
of order O(N), then it cannot be an irreversible entropy production. 

Therefore, the agreement between AiSfJ? and A t hSf® in the stationary state with their IT counterparts 
achieved only after a coarse graining dependent relaxation time, appears accidental. This suggests that the 



very definitions of the various terms on the right hand side of Eq.(17) cannot be physically correct. Again, the 
macroscopic limit of BTV may fix this problem. 



4.4 The multibaker space difficulty 

Simple dynamical systems such as the multibaker maps are very useful in understanding many aspects of chaotic 
dynamics. In a sense we could say that they play in this context a role similar to that of exactly soluble models 
in equilibrium statistical mechanics. However, the solvability often goes at the expense of the degenerately 
simple nature of the models themselves, which, in the case of multibaker chains, becomes cause of concern when 
one wants to identify certain features of the multibaker dynamics with known IT properties of real systems. 

In particular, in order to speak of a quantity in some way related to the Gibbs entropy, one would need a phase 
space, in which (at least up to canonical transformations) half of the dimensions represent the "configurations" 
of the system in space and the other half represents the "momenta" . Then, in that phase space a coarse grained 
information entropy can be defined, which multiplied by ks and in the limit of fine graining becomes the Gibbs 
entropy itself (if it exists). To do this in a multibaker chain one has to identify position and momentum variables. 
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These are assumed by BTV to be represented by the horizontal (along the chain) direction, and by the vertical 
(along the thickness of the chain) direction, respectively. If this identification is correctly carried out, then the 
multibaker phase space, being 2-dimensional, could only be a substitute for a 1-particle model in one dimension. 
Alternatively, the 1-particle distribution could be used to describe a gas of identical noninteracting particles, 
perhaps in the presence of obstacles, as in the Lorentz gas. However, even the picture of the gas of independent 
particles is at odds with the BTV interpretation of the multibaker dynamics: points at different heights along 
the vertical direction of the baker rectangles can move in exactly the same way under the baker dynamics of 
the model, while points which are at the same height can move in totally different directions. Therefore, the 
vertical direction has nothing to do with momentum space. 

This problem could perhaps be fixed by interpreting the baker dynamics and phase space differently. Like 
in H H , one could assume that the multibaker phase space mimics a Poincare section of a particle system such 
as the Lorentz gas. The dynamics is followed from rectangle to rectangle like a moving particle in the Lorentz 
gas is followed from collision to collision. In that case, the problem of identifying the momentum variables is 
not so important anymore. However, two new problems emerge. In the first place, the coarse grained entropy of 
the system should be expressed in terms of all the phase space variables, and not just in terms of the variables 
of the Poincare section. Therefore, the contributions due to the direction of the flow need to be worked out. 
However, perhaps more importantly, with this interpretation one would also lose the possibility of taking the 
BTV macroscopic limit, because one cannot assume that particle collisions occur at a rate which is coarse 
graining dependent. This because in G's interpretation one time step is the time elapsed between two collisions, 
but the time step goes to zero as the graining is made finer and finer in the BTV macroscopic limit. 



4.5 Factorizability, entropy and entropy production 

We now try to understand under which conditions the results obtained for multibaker models in the 1-point 
space are valid for independent many-points systems. This leads us also to an analysis of the relationship 
between the definitions of entropy and entropy production rate, given in We follow || ||, also in order 

to point out some subtleties of that approach. 

Consider a distribution fi in the 1-point baker space. The associated Poisson suspension, corresponding to 
a "gas" of infinitely many independent points [^j, Q , is characterized by the probability measure 

x(Cb,n) = ; with X {C B ,n D C B , tN ,) = x(Cb,n)x(C B >,n>) if B H B' = , (40) 

where x(Cb,n) is the probability of finding N points in the 1-point volume B, and Cb.n is the corresponding 
set in the phase space of the Poisson suspension. It is in this phase space that G can define his coarse grained 
e-entropy for a boundary driven system. If then {Bi} is a partition of the 1-point space in cells of volume e, 
this entropy takes the form (cf. Eqs.(8.98),(8.99) of g): 

OO 

Se({Bi}) = -^^x(C B „«)logx(C B , !N ) (41) 
i n=q 

= J2^Bi)log^^+n(s) (42) 



where the rest term is 



^) = -E^ (Sl) E^§^ lo g^ ! - ( 43 ) 

i N=a 



The terms inside the external sum are of order 0([i(Bi) 2 ) and higher, hence can be neglected in Eq.(f42|) if /x(-Bi) 
is small. This is obtained for a multibaker system of length L, by taking sufficiently fine partitions, i.e. Bi of 
sufficiently small volume. 
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This step is of fundamental importance for the IT-like results of fa [4| to be valid for a many-point system. In 
fact, these results are obtained using the first term of Eq.p^) only, neglecting 71(e). However, in principle, 71(e) 
could be large, compared to the first term in Eq.(^2|), because the macroscopic limit (L — > oo for multibaker 
maps) has to be taken before the fine graining limit (cf. discussion below Eq.(8.126) of Q). This means that, 
however small the volume of Bi might be, as long as it does not vanish, its measure fJ.(Bi) will be large in 
general, since the density will be large, making 71(e) also large. In this case, neglecting 71(e) implies that the 
IT-like results are not derived from the many-points distribution Xi but instead from a kind of information 
entropy defined through the 1-point distribution \x. Now, because \i is not normalized, it cannot be a factor of 
a many-points distribution, making those results valid only for a 1-point system]^] 

Gaspard overcomes this difficulty in an ingeneous way, by splitting the fine graining limit into two steps: The 
limit of vanishing linear size of the partition cells along the unstable direction is taken before the macroscopic 
limit, the remaining limit of vanishing linear size of the cells Bi along the stable direction is taken after the 
macroscopic limit, so that the macroscopic limit "interrupts" the fine graining process. This way, the volumes 
of the partition cells are made vanishing before the macroscopic limit is taken, 71(e) can be neglected and the 
results presented in Section 3. follow. 

However, the fine graining limit, in particular the part taken before the macroscopic limit, comes at the 
cost of losing the coarse grained information entropy (which then diverges). Similar considerations hold also for 
the results of BTV and GD, therefore it seems that the knowledge of both the entropy and its production rate 
cannot be given together with the present approaches, as already noted for the thermostatted approach. 

4.6 The thermostat difficulty 

The need for the term A^Sfj? (X) in Eq.(|l6|) was deduced by GD from the fact that the information entropy 
flow A e SfJ?(X) cannot represent an entropy flow between the system and its environment, if the system is closed 
or periodic. Nevertheless, this seems to be at odds with IT. Indeed, a(x)pi is merely introduced to enable the 
externally driven dynamical system to reach a stationary state as is done automatically by a thermostat in A e S 
in IT. In fact, it is for that reason that a(x)pi is usually referred to as the "thermostat" of the system. However, 
dynamically, this term has nothing to do with a real thermostat and, in fact, it appears in Eqs.(^|) as a Lagrange 
multiplier, due to the application to the iV-particle system of Gauss' (purely dynamical) principle of minimum 
constraint, to make the system preserve its kinetic or total energy in the course of time. In the derivation of 
Eqs.(|^), no use is made of the properties of any other dynamical system constituting a thermostat. Therefore, 
an interpretation of a(x)pi as representing an actual physical thermostat, which absorbs the dissipative energy 
created in the system by the external forces F e , and has an explicit representation in the entropy balance 
Eq. ([ll]) , is an interpretation which appears to have no basis in the purely dynamical nature of the equations 
(||) themselves. 

What can be said, instead, is that Eqs.(^J) serve as a convenient tool to describe a system in a nonequilibrium 
state by purely dynamical means, without incurring the technical difficulties posed by infinitely large reservoirs. 
That a real system would not settle on a nonequilibrium state without the presence of a real thermostat, seems 
irrelevant in the analysis of the dynamics of Eqs.(^). 

5 Discussion 

1. The above discussion on the coarse grained approach to a complete dynamical theory of IT pointed out 
difficulties which we found in the current formulations. Therefore it seems to us that a coarse grained entropy 
approach based on Sq does not provide at present a satisfactory connection with IT. The same can be said 
about thermostatted systems. However, for the latter systems the irreversible entropy production is at least 

11 To have a normalized 1-point distribution, one would have to implement the boundary conditions in a different way, using, e.g., 
a compact phase space with biilk dissipative dynamics, like in thermostatted systems, or with biased dynamics in certain regions 
(e.g. the walls) of the system M]. 
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unambiguously known at any time: in the transient as well as in the stationary state. This is not the case in 
the coarse grained description. Indeed, we pointed out various difficulties which affect the treatments of IT 
provided by BTV, G and GD. The approach of BTV could avoid the problems connected with the transient 
states, and it is worthwhile to further study this topic, but the phase space dynamics seems to be very special. 
On the other hand, the approach of G and GD was intended to describe stationary states only p3] , despite the 
full time dependent treatment they give || [| [jj . 

2. It seems that the possibility of identifying in thermostatted systems other contributions, beyond the 
irreversible entropy production term, occurring in IT, is not obvious. On the basis of our analysis we would 
argue that, so far, the dynamics of thermostatted systems allows us only to identify the irreversible entropy 
production rate. It is obvious that a stationary state of a real system, with a given irreversible entropy 
production rate will be affected by an equal and opposite divergence of an entropy flow. Nevertheless, this 
does not emerge from the dynamics of thermostatted systems. The connection of dynamical properties of 
thermostatted systems with the term divJs jtot occurring in IT, remains therefore unclear. 

3. Although the idea of a possible connection between coarse-graining, information loss and entropy changes 
discussed here is very intriguing, as far as we can tell, it does not seem to work in its present form for macroscopic 
systems, as long as one connects it with Sg, which diverges to — oo. The fact that the rate of change — Sg 
equals the irreversible entropy production rate of thermostatted systems does not seem to be a reason sufficient 
to assume that Sg itself has any direct connection with the entropy of such a system. Morever, the connection 
of the information loss used here with the usual (Kolmogorov-Sinai) information loss, if any, and its relevance 
for the calculation of the IT entropy is also not clear to us. Therefore, it seems to us that further study of the 
connection of the dynamics of particle systems in nonequilibrium states and IT is still required. 
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Figure captions 



Figure 1. One time step in the evolution of the infinite multibaker chain. The squares with labels 0, 1, L 
constitute the system. The others constitute the reservoirs. One time step corresponds to one application of </>, 
which moves the poins with a given shade to the points with the same shade. This time evolution is volume 
preserving, hence it does not affect the density of points. Starting from any initial distribution, we see how the 
densities of the baths enter into the system. In the stationary state, only the blackest and the white densities 
fill the cells of the system. 

Figure 2. One time step of the evolution of the BTV multibaker model. Unlike in Fig.l, there is phase space 
contraction here if I ^ r. The same dynamics of Fig.l is obtained if s — and I — r = 1/2. One time step 
moves the points of the different vertical strips of rectangle m with a given shade to rectangle m — 1, m or 
hi + 1, respectively, with the same shade. 

Figure 3. From left to right we have the partition A, in in the baker square m, the partition <j)~ 1 A 1 and the 
partition (f)~ 1 A'V A, in the baker square m+ 1, respectively. The preimage <j>~ 1 A of every set A in cell m, which 
is the union of cells of A, can be partitoned by cells of 4>~~ 1 A V A, while it cannot be partitioned by cells of A 
itself. 

Figure 4. In the left panel is depicted the decay of the IT entropy from a transient to a stationary state, 
which takes a time of the order of the Maxwell relaxation time (or is determined by an appropriate transport 
coefficient). Here we have assumed that the initial (equilibrium) entropy is higher than the steady state entropy. 
The right panel shows the decay of the coarse grained entropies for various partition sizes (curves labelled by 
(1), (2) and (3)), and the divergence of the Gibbs entropy (thickest line). All the coarse grained entropies start 
from the same value, and eventually settle on a plateau. However, they remain close (within a distance 6, say) 
to Sg for longer and longer times if the relevant partitions are finer and finer. Curve (1) corresponds to the 
coarsest partition. The region delimited by curve (2), by Sg and by the two vertical (solid line) segments is 
made of points whose distance from Sg is less than 5. 
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